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Title: Clock Offset Estimation with Bias Correction 
Field of the Invention 

The present invention relates to synchronization of clocks. More specifically, the 
present invention relates to estimation and correction of clock offset in distributed 
resources interconnected by a network, such as the Internet. 
Background of the Invention 

Accurate and reliable time information is necessary for many systems and 
applications involving distributed resources, including networked systems and processes 
typified by the Internet. In such systems, different functional elements are required to 
have their clocks synchronized. Clock synchronization involves two aspects: frequency 
synchronization and time synchronization. The former means that element clocks run at 
the same firequency, and the latter means that elements agree at a particular epoch with 
respect to the coordinated universal time (UTC), i.e., there is no offset between element 
clocks. For many purposes, it is appropriate to focus on estimating clock offset and to 
assume higher order effects, such as the frequency offset, can be ignored or provided for 
separately. 

Clock synchronization issues have been extensively addressed in the literature. 
See, for example, D. Mills, Internet time synchronization: the Network Time Protocol, 
IEEE Trans. Communications, Vol. 39, No.lO, October 1991; D. Mitra, Network 
synchronization: analysis of a hybrid of master-slave and mutual synchronization, IEEE 
Trans. Communications, COM-28, 8 (August 1980), pp. 1245-1259; andN.W. Rickert, 
Non Byzantine clock synchronization - a programming experiment, ACM Operating 
Systems Review 22,1 (January 1988), pp.73-78. 

A well-known clock synchronization protocol that has been successfully deployed 
in the Internet is the Network Time Protocol (NTP), described, for example, in D. Mills, 
Network Time Protocol (version 3) Specification, Implementation and Analysis RFC 
1305, March 1992. One of the most important network clock synchronization issues 
addressed by NTP is how to use the collected data to estimate the clock offset between a 
pair of network elements. 

In V. Paxson, On Calibrating Measurements of Packet Transit Times, LBNL- 
41535, ftp://ftp.ee.lbLgov/t)aDers /vp-clocks-sigmetrics98.p s.gz. March, 1998 (and in a 
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shortened paper with the same title published in Proc. ACM Sigmetrics98, June 22-26, 
1 998), the author proposed a new algorithm for clock offset estimation. For easy 
reference, this algorithm will be referred to as the Separate Direction Estimation 
Algorithm (SDEA). While SDEA can provide improved performance relative to the 
NTP algorithm, SDEA nevertheless suffers from significant limitations, especially in 
applying SDEA to contexts in which loading is different for each of the directional links 
between pairs of network elements. 
Summary of the Invention 

Limitations of the prior art are overcome and a technical advance is made in 
accordance with the present invention, illustrative embodiments of which are presented in 
the following detailed description. In particular, limitations of the NTP algorithm and 
SDEA are overcome and SDEA techniques are extended and improved in accordance 
with present inventive teachings. 

In addition to estimating the clock offset, present inventive techniques also 
estimate the bias of the estimation and attempt to correct any such bias. As a result, 
present inventive algorithms show significant improvement in terms of convergence 
speed and accuracy. Illustrative embodiments of present inventive algorithms will be 
referred to as Separate Direction Estimation Algorithms with Bias Correction 
(SDEABC). 

In accordance with one aspect of present inventive methods, messages are 
exchanged (bi-directionally) between pairs of network elements, such messages including 
limestamps indicative of sending and receiving times noted at each stop. Because 
variable components of delay for each message direction need not be characterized by 
identical probability distribution functions, e.g., when links in each direction are 
differently loaded, undesired bias of estimates for clock offset can emerge. Illustrative 
embodiments of the present invention avoid errors in estimates of variable delay 
minimums by separately determining these minimums, e.g., by advantageously 
employing separate empirical probability distributions for each direction. 
Brief Description of the Drawing 

FIG. 1 illustrates time relations in sending messages between network elements. 
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FIG. 2 shows an illustrative network embodiment of the present invention having 
a single server node for interacting with a plurality of other nodes to effect clock 
correction at such other nodes. 

FIG. 3 shows an illustrative network embodiment of the present invention having 
5 a hierarchy of server nodes with lowest order server nodes for interacting with other 
network nodes to effect clock correction at such other nodes. 
Detailed Description 
Separate Direction Estimation Algorithm 

In network clock synchronization, each of a pair of network elements exchanges 
1 0 data packets (timing messages) with the other of the pair. One of such a pair is referred 
to as a sender, and the other as a receiver with respect to a particular packet. Based on 
time stamps contained in these timing messages, the clock offset between the sender and 
the receiver is estimated. 

More specifically, timing messages are sent between network elements as shown 
1 5 in FIG. 1 , where activities at a sender 100 and a receiver 110 are shown for a particular 
round of message exchanges. At the i-th round of message exchange, the z-th message 

includes a time stamp T^^ indicating current time as known at the sender 100 when the 
message is sent to the receiver 110. Immediately upon reception of this message, 
receiver 1 10 puts a time stamp 7^^ in the received message. The receiver then puts 

20 another time stamp T^^ on the message immediately before sending the message back to 
the sender. When sender 100 receives the message, it records the receiving time 7]^ . 
Using T" ,TI , for i = 1,2, the sender computes an estimate of the clock offset as 

between sender 100 and receiver 110. 

Let 6 be the receiver's clock offset from the sender. That is, if at a given instant 
25 the receiver's clock shows time t^ and the sender's clock shows time , then O^t^-t^Ai 
proves convenient to denote the fixed delay from the sender to the receiver (called 
upward direction) by d"^ and the fixed delay from the receiver to the sender (called 
downward direction) by d"^ , In this representation, the fixed delay includes all non- 
variable components of the delay such as transmission delay and propagation delay. 
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Let denote the variable component of the delay of the i-th message from the 
sender to the receiver and ef denote the variable component of delay from the receiver to 
the sender. The variable delay component is the part of the delay that would not occur 
under ideal conditions, and includes such delays as packet queuing delay and delay due to 
5 the unavailability of shared resources (e.g. , CPU or bandwidth). 
We then have the following equations 

7;^-7;«=rf"+0+< (1) 

T,'-T^'=d'-e + e: (2) 
For ease of further description of present inventive algorithms, it proves 
1 0 convenient to define X,^T^'~ T^' and Y^^T^'-T^\ where after the exchange 

of n messages. 

The above-cited SDEA keeps the smallest values of and Y^, viz., it keeps 
variables 

1=1, • ,n 

15 and 

1=1,.. ,« 

The estimate for 6 using n samples is then computed as 

i={U„-V„)l2. (3) 
Separate Direction Estimation Algorithm with Bias Correction (SDEABC) 
20 From (3), with £■[•] as the expected value operator we can see that, assuming 

Em = E[U„-V„]l2 

= d + {E[ mm {< }] - E[mm {ef }]) 12. (4) 

Therefore, the SDEA is asymptotically unbiased if the pdf of both e" > 0 and ef > Ois 
25 positive near 0. However, with a finite number of samples, the estimator is biased if 
E[ min {e," } ] E[ min {ef } ] , a not unlikely event because of differences between uplink 
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and downlink traffic loading. As will be seen, illustrative embodiments of the present 
invention reduce such errors in estimates due to bias. 

The empirical distribution of a random variable i? > 0 is illustratively constructed 
in a manner now to be described. Suppose R is independently sampled n times with the 
5 result being r;, . , . , r„. We rearrange the n samples so that r^.^ < r^,^ < ... < r„.„, where each 

r, n is from the original sample set. Further, let = 0 and r^+j n= ^ • The empirical 
distribution of R is then 

«+l 7 — 1 

ti n 

where /(•) is an indicator function, i.e., /(•) = 1 when the argument of / is satisfied, and is 
1 0 0 otherwise. Equivalently, the complementary distribution function is 

Fn{x) = %{^^^)I{r^^,^<x<rJ, (6) 
1=\ n 

Note that since the intervals {ru:n, n-n) are non-overlapping, 

(l-FJx))" <x</:J (7) 

15 Suppose that independent, identically distributed (i.i.d.) random variables Ri^ 

i=I,2,...,n have a distribution function F( x ). Then, min^^j{i?J has the complementary 

distribution functions (l~F(x)y . Define 

7„^^£[rain;U {;?,}], 

By using the empirical distribution function Fn(x) to replace F(x), an estimate of , yH > 
20 is obtained as 

7^ =]il-F„{x)rdx 

0 

r!f =I(^^r*(^„-'-MJ- (8) 

As shown in (4), the bias of the SDEA estimator is 

b„^E[i]-e , 
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and an estimate of this bias, bn , is given by 
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20 



bn=((r:-r:)/2)-e„. 



(9) 



Based on the foregoing, it can readily be seen that a more accurate determination 
can be made of clock offset by correcting for bias of estimates made using SDEA. That 
is, by determining analytically what the bias in an estimate using SDEA is in a particular 
environment, correcting by an amount equal to the bias achieves a more accurate estimate 
of clock offset. This more accurately estimated correction is then advantageously applied 
to the out-of-synchronization clock. Moreover, the expected value of the bias provides a 
monitor for the analytical process; variations of this expected value over time can signal 
conditions in a network that may indicate greater or lesser confidence in clock offset 
estimates. 

In accordance with an approach that is preferred for some applications, a method 
again proceeds from evaluation of e„ = (C/„ - FJ / 2 , as in Eq. (3). Since 

.,,71 



and 



'=1, . ,« 



forming the expected value of each side of Eq. (3) and employing the notation from Eq. 
(8) for each of random variables U„ and V„ yields 

E[ej = E[(U„-VJV2 
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We may take 
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but in forming an estimate of Z?„ , the bias in the estimate of 9 after n samples, we 
employ 

Then, in accordance with the present approach, a bias-corrected (BC) estimate 
5 (SDEABC) for 6 is given by 

= (min{X,}~min{Y,})~iY''^ -y-). 

FIG. 2 shows an illustrative single-server network deployment of present 
inventive techniques. Specifically, FIG. 2 shows a time server 200 connected through a 

1 0 network 2 1 0 to a plurality of other network nodes 220-/, z = 1 , 2, . . . , N. Nodes 220-z may 
be routers, switches, servers of various kinds, network end points (including terminals, 
workstations or computers), or any other kind of network node. Each of nodes 220-i has 
a clock and messaging facilities for exchanging messages with time server 200 in the 
manner described above. That is, time server 200 forms one of the pair of nodes and, in 

1 5 turn, one or more (typically all) of the nodes 220-z forms the other of the node pair for 
purposes of exchanging time-stamped messages and deriving offset estimates and 
estimate bias information. While each of the nodes 220-/ may have equal access to time 
server 200, priorities may be accorded some nodes 220-/, or some nodes 220-/ may be 
accorded access to server 200 more frequently. 

20 By exchanging messages with nodes 220-i, time server 200 will provide clock 

offset estimates and estimate bias information as described above, which information is 
available at nodes 220-i for correcting clock offset. Of course, N may have a value of 1 , 
so that only a single network node device may interact with a particular time server. 
While time server 200 is shown as a separate dedicated function network node, it will be 

25 understood that the function of network node 200 may be included in a node performing 
other functions. Likewise, many network arrangements will have a plurality of time 
servers, each serving network nodes connected on a respective network or sub-network 
210. 
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FIG. 3 shows an illustrative alternative network arrangement in which a plurality 
of time servers 330 and 340-?, z = 1, 2, . . M, are connected in hierarchical relation 
through a plurality of networks 3 1 0-z, / = 1 , 2, . . . , M. hi the illustrative arrangement of 
FIG. 3, only two levels are shown in the server hierarchy, but those skilled in the art will 
5 recognize that any number of levels of time servers may be used. Likewise, while the 
number of networks is shown equal to the number of nodes at the lowest hierarchical 
level, no such limitation is required in practicing the present invention using a 
hierarchical arrangement of time servers. Each of the networks 3 10-z has one or more 
network nodes capable of accessing the respective time server connected to the network. 

10 By way of illustration, network 310-1 has nodes 350-1 1 through 350-lP connected to it. 
Likewise, network 3 10-M is shown having nodes 350-Ml through 350-MQ. Here, P and 
Q may be any integer. 

In operation, time server 330 exchanges time-stamped messages with each of the 
time servers 340-i to provide the latter with offset estimates and estimate bias information 

1 5 of the type illustrated above to permit clock correction at the illustrative (second-level) 
time servers 340-i. Each of the time servers 340-i then serves the clock correction 
requirements of respective nodes 350-xx in the same manner. Of course, when more than 
two hierarchical levels of time servers are used, each level (after the first or highest) 
derives clock synchronization information from a time server at the next highest level. 

20 The number of nodes will generally vary from one network 3 1 0-i to another, and all or 
some of networks 3 10-i may be sub-networks of a larger network. Some time servers 
may be connected to nodes such as 350-xx and to a next lower order node as well. Some 
or all time servers may be located in the same local area or distributed over a wide area 
(including globally) to meet load and geographic distribution requirements for clock 

25 synchronization service. 

Access to respective time servers by particular nodes (or subordinate time servers) 
may be scheduled (e.g., periodic), dependent upon availability of time server resources, 
dependent on prior clock offset behavior at particular nodes (or subsidiary time servers) 
or detected conditions at such nodes or subsidiary time servers. Exchange of messages 

30 and derivation of correction information in accordance with present inventive teachings 
may be initiated, in appropriate cases, by a particular time server or by a node (or 
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